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ABILITY,  INVOLVEMENT  AND  CLIMATE 
AS  MULTIPLE  AND  INTERACTIVE  PREDICTORS  OF  PERFORMANCE 

R.  Gene  Hoffman 

Indiana  University  - Purdue  University 
Indianapolis,  Indiana 

For  a number  of  years,  researchers  have  recognized  the  potential  Im- 
pact of  the  Joint  effects  of  individual  differences  and  situational  differ- 
ences on  individual  task  performance.  Following  Cronbach's  (1957)  directive 
to  look  for  aptitude/treatment  interactions,  research  in  education  has 
ballooned  to  an  almost  incomprehensible  collection  of  studies  examining 
such  interactions  (Cronbach  & Snow,  Note  I).  Organizational  psychology 
has  also  been  bitten  by  the  person/si tuatlon  cal)  to  order.  There  have 
been  numerous  attempts  to  understand  the  Interactions  between  individual 
differences  and  situational  differences  as  they  relate  to  performance, 
particularly  in  the  field  of  leadership  (Kerr,  Schriescheim,  Murphy  & 

Stodgill,  197*0,  climate,  (Hellrlegel  & Slocum,  197**),  and  In  motivation 
(e.g.,  Hackman  6 Oldham,  1975).  The  excitement  over  person/situation  In- 
teractions has  been  predicated  on  the  belief  that  the  interaction  contains 
the  greatest  source  of  understanding  (Atkinson,  197**)  and  predictive  accur- 
acy (Dunnette,  1963). 

A number  of  issues  can  be  raised  about  the  exclusive  focus  on  the  inter- 
action as  the  primary  source  of  understanding.  These  include  (I)  the  fre- 
quent failure  to  analyze  both  regression  coefficients  and  correlation  cd- 
efflcients  as  related  but  lot  identical  descriptions  of  the  person/performance 
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relationship  (Cronbach  6 Snow,  Note  1),  (2)  the  failure  to  consider  mean 

differences  in  performance,  in  addition  to  relationship  differences,  which 
may  be  created  by  situational  differences  (Schneider,  1978a)  and  (3) 
problems  centering  on  the  measurement  of  situational  differences  (Schneider, 

1975;  Schneider  6 Snyder,  1975). 

With  respect  to  the  first  issue,  Cronbach  and  Snow  (Note  1)  and 
Cohen  and  Cohen  (1975),  among  others,  indicate  that,  in  the  strictest  sense, 
an  interaction  is  conceptualized  as  a relationship  between  two  variables 
that  is  conditional  on  the  value  of  a third  variable,  and  that  the  rela- 
tionship difference  appears  in  the  regression  slope.  Thus,  differences  in 
correlation  coefficients  for  subgroups  may  or  may  not  be  accompanied  by  an 
interaction,  depending  on  the  variance  in  the  predictor  and  criterion  vari- 
ables. Conversely,  an  interaction,  i.e.,  difference  in  slopes,  is  not 
necessarily  indicative  of  a difference  in  predictive  accuracy  as  defined 
by  the  correlation  coefficient. 

To  complicate  matters  further,  a significant  difference  between  corre- 
lation coefficients  Indicates  predictive  accuracy  within  each  subgroup 
(i.e.,  one  minus  the  sum  of  the  residuals  squared  divided  by  performance 
variance  for  the  subgroup).  Since  the  performance  measure  is  identical 
for  each  subgroup,  one  could  also  directly  compare  errors  of  prediction  be- 
tween subgroups.  It  is  possible  to  find  differences  in  correlations  be- 
tween two  subgroups  in  which  errors  of  prediction  (i.e.,  sum  of  residuals 
squared)  were  identical  for  the  subgroups.  Similarly,  one  might  find  a 
significant  interaction  (i.e.,  slope  differences)  accompanied  by  correla- 
tional differences  (differential  validity),  but  with  the  same  errors  of 
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prediction.  Thus,  regression  slopes,  correlation  coefficients,  and  aver- 
age squared  residual  scores  all  provide  related  but  separate  pieces  of 
Information,  each  suggesting  a somewhat  different  perspective  for  exam- 
ining person/situation  joint  effects. 

A second  issue  concerning  the  interpretation  of  situation  effects 
on  the  person- performance  relationship  concerns  group  meau  differences 
on  the  performance  criteria  that  may  be  created  by  situational  differ- 
ences. Kerlinger  and  Pedhazur  (1973)  recommend  that  when  an  Interaction 
is  found,  it  is  not  necessary  to  test  for  main  effects.  Their  suggestion 
seems  consistent  with  the  very  definition  of  an  interaction  --  that  the 
main  effect  of  a variable  is  not  constant  over  the  values  of  some  third 
variable.  On  the  other  hand,  information  is  lost  if  only  regression 
and/or  correlation  coefficients  are  examined.  For  example,  knowing  only 
that  the  ability-performance  relationship  is  stronger  in  a consistent 
ctimate  (e.g.,  innovative  and  close  supervision),  as  shown  by  Frederiksen 
(Note  2)  gives  no  indication  as  to  which  situation,  consistent  or  incon- 
sistent, had  the  best  overall  level  of  performance.  Fiedler's  (1971)  re- 
search on  leadership,  for  example,  has  been  criticized  on  precisely  this 
point  (Landy  6 Trumbo,  1976). 

The  importance  of  this  issue  becomes  obvious  when  it  is  realized  that 
two  competing  assumptions  about  the  effects  of  situations  on  ability-per- 
formance relationships  exist.  In  the  field  of  Industrial/organizational 
psychology,  it  has  been  suggested  that  situations  be  structured  to  maxi- 
mize the  abi 1 1 ty- performance  relationship  (Schneider,  1975;  1978a)  In 
order  to  maximize  individual  potential  and  therefore  to  maximize  the  collec- 
tive output.  In  fact,  it  has  even  been  suggested  that  the  ability-performance 
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relationship  be  used  as  a sign  of  organizational  health. 


On  the  other  hand,  one  gains  the  opposite  implication  from  the 
educational  literature.  For  example,  Cronbach  and  Snow  (Note  I)  hypo- 
thesize that  a low  correlation  between  pre-test  and  post-test  scores  in- 
dicates that  the  instructor  has  overcome  student  deficiencies.  For  these 
latter  scholars,  situations  which  exhibit  low  regression/slopes  are  ex- 
pected to  show  the  highest  overall  criterion  performance. 

Thus,  one  may  not  want  to  presume  whether  overall  criterion  perform- 
ance is  higher  or  lower  for  situations  which  have  high  person/performance 
relationships.  Note  that  the  answer  to  this  issue  does  not  lie  in  looking 
at  intercept  differences  (Kerlinger  6 Pedhazur,  1973).  Since  the  regres- 
sion lines  for  each  situation  are  not  parallel  and  the  range  of  predictor 
scores  may  lie  some  distance  from  the  y-axis,  the  differences  in  the  y- 
intercept  may  be  totally  misleading.  Therefore,  examination  of  subgroup 
performance  means  seems  to  be  the  straightforward  solution. 

Another  issue  concerning  person/situation  interactions  concerns  the 
measurement  of  situations,  particularly  in  correlational  studies  where 
situational  differences  are  assessed  by  participant  judgments,  it  has 
been  suggested  (Schneider,  1978b)  that  the  person/situation  interaction 
may  be  confounded  in  the  measurement  of  the  situation.  That  is,  reports 
by  an  individual  of  the  situation  are  an  amalgam  of  both  individual  and 
situational  differences  which  may  contain  interaction  information.  At- 
tempts to  find  a statistical  interaction  between  these  reports  and  individ- 
ual characteristics  may  be  a redundancy  that  would  fail  (Schneider,  1978b). 
This  argument  Is  similar  to  the  criticism  Mobley  and  Locke  (1970)  made 
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of  attempts  to  weight  job  facet  satisfaction  responses  by  importance.  A 
person/situation  interaction  may  conceptually  be  present  but  statistically 
confounded  at  the  individual  level  of  analysis.  However,  if  Schneider's 
(1975)  prescriptions  for  assessing  situational  conditions  as  an  aggregate 
of  the  perceptions  of  individuals  is  followed,  then  the  collective  data 
should  be  less  systematically  contaminated  by  individual  differences  and 
therefore  more  likely  to  exhibit  person/situation  interactive  effects. 

The  use  of  interactions  has  helped  our  understanding  beyond  that 
possible  with  the  bivariate  approach.  For  example,  some  of  the  confusion 
in  leadership  research  has  been  clarified  by  using  contingency  models 
(Kerr,  et  al.,  197**;  House  & Mitchell,  197**)  which  highlight  the  signifi- 
cance of  situational  moderators  (some  of  which  are  follower  characteristics) 
of  the  relationship  between  leadership  characteristics  and  some  criterion 
of  leadership  effectiveness.  On  the  other  hand,  Cronbach's  (1975)  analysis 
of  educational  research  finds  that  the  simple  person/situation  (i.e.,  edu- 
cational treatment)  interaction  i s difficult  to  find  because  it  seems  to  be 
masked  by  higher  order  interactions.  Note  that  in  the  research  reviews 
by  Cronbach,  situational  differences  were  most  often  gross  qualitative 
treatment  differences,  while  the  leadership  literature  most  often  focuses 
on  variance  on  one  dimension  of  the  situation  (e.g.,  task  ambiguity  or  some 
aspect  of  climate).  This  difference  in  focus  suggests  the  possibility 
that  person/situation  interactions  in  situations  that  are  multidimensional 
may  be  unstable  and  difficult  to  find  because  of  variance  within  similarly 
defined  situations.  For  example,  Jackson  (1962)  has  suggested  that  it  is 
narrow-minded  to  view  all  teaching  alike;  that  teacher  characteristics 
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within  simitar  methods  may  have  influence  on  the  relationship  between 
students'  ability  and  their  performance.  Such  within  method  effects  may 
cloud  any  interactions  between  difference  methods  and  the  ab i l i ty /perform- 
ance relationship. 

The  focus  of  this  research  is  on  instructor  behaviors  as  an  influence 
on  student  performance  directly  and  on  the  relationship  between  student 
ability  and  performance.  Instructor  behavior  can  be  conceptualized  as  a 
situational  variable  much  the  same  way  as  leadership  or  managerial  style 
has  been  used  as  a climate  variable  (Hellreigel  S Slocum,  197*0.  In  light 
of  the  above  discussion,  the  present  research  examines  the  effects  of  in- 
structor behavior  as  perceived  by  each  individual  and  also  as  aggregated 
at  the  group  (l.e.,  class)  level.  Moderated  multiple  regression  in  which 
interaction  information  "Is  carried  by"  (Cohen  & Cohen,  1975).  a product 
term  will  be  used  to  examine  slope  differences  as  a function  of  teacher 
style.  If  Interactions  are  found,  teachers  with  similar  style  on  the  re- 
levant teacher  dimension  will  be  subgrouped  so  that  mean  differences  in 
student  performance,  differences  in  prediction  errors  between  subgroups, 
and  differences  between  subgroup  correlations  can  be  examined  in  relation 
to  teacher  style. 

METHOD 

Subjects  and  Procedure 

Students  In  75  sections  of  an  introductory  methematics  course  com- 
pleted a faculty  evaluation  questionnaire.  The  questionnaire  was  modified 
to  ask  students  to  provide  their  student  identification  numbers  and  SAT 
Math  scores.  The  questionnaire  indicated  that  the  student  numbers  were  for 
research  purposes  only  and  would  not  be  given  to  the  instructor.  Such 
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instructions  appear  to  reduce  the  potential  bias  associated  with  the  identi- 
fication process  (Sharon  6 Bartlett,  1969).  The  student  numbers  were  nec- 
essary to  match  student  questionnaire  responses  to  course  performance. 

students  who  did  not  provide  their  student  numbers  were  not  used  in 
the  analysis.  This  reduced  the  sample  from  1213  students  to  915  students 
and  eliminated  one  entire  section.  The  mean,  across  all  sections,  of  the 
average  within  section  examination  score  (all  students  included)  was 
72.65,  compared  to  a mean  of  75.33  for  the  students  that  responded  to 
the  questionnaire  and  provided  their  student  numbers.  This  suggests  that 
the  sample  used  in  this  analysis  tended  to  exclude  the  lower  performing 
students.  However,  the  fact  that  one  entire  section  refused  to  provide 
their  student  numbers  suggests  that  something  other  than  performance  level 
influenced  the  decision  not  to  identify  themselves.  Average  performance 
for  that  class  was  above  the  average  performance  of  the  other  classes;  it 
was,  however,  within  one  standard  deviation. 

Variables 

Instructional  style  was  assessed  by  four  scales  of  the  Check-List  of 

Instructional  Characteristics  (CLIC;  Hoffman,  1976).  These  indluced  (1) 

Knowledge  and  Skill,  indicating  the  instructor's  knowledge,  organ i zation  and 

* 

clarity,  (e.g.,  "explained  how  topics  in  the  course  were  related  to  each 
other").  (2)  Consideration,  which  describes  instructor  activities  which 
facilitate  interaction  ("asked  students  questions"),  (3)  Critical  Demands, 
which  indicates  the  instructor's  str.ctness  with  students  ("criticized 
students  in  front  of  others"),  and  (**)  Coordination,  which  describes  the 
degree  to  which  class  presentation,  readings  and  examination  were  integrated 
by  the  instructor  ("examination  questions  could  be  anticipated").  When 
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averaged  across  students  within  each  class,  these  scales  provide  an  index 
of  students'  "shared  perceptions"  (Schneider,  1975)  of  the  classroom  "climate." 
They  were  also  treated  as  individual  variables  representing  individual  per- 
cept i ons . 

One  additional  CLIC  scale  was  also  included  in  the  analysis.  It  de- 
scribes Student  Involvement  in  the  course  and  therefore  was  treated  as  an 
individual  differences  variable  and  not  a class  differences  variable.  Con- 
ceptualized as  a situation  specific  variable,  Student  Involvement  was  exam- 
ined both  as  an  independent  variable  for  performance  and  as  mediator  of 
the  course  climate. 

Estimates  of  student  SAT  Math  scores  were  obtained  on  the  faculty 
evaluation  questionnaire  by  asking  students  to  indicate  which  of  five 
score  intervals  contained  their  SAT  Math  score.  Intervals  were  constructed 
such  that  the  middle  interval  obtained  the  mean  freshman  SAT  Math  Score. 

Student  performance  was  assessed  by  five  course  examinations.  The 
examinations  were  identical  for  all  class  sections.  Individual  student 
performance  was  calculated  as  the  mean  of  their  five  examination  scores. 

Analys i s 

Two  parallel  regression  analyses  were  conducted.  Each  was  conducted 
at  the  individual  level  of  analysis  with  individual  class  performance  as 
the  criterion  and  individual  student  ability  and  individual  Student  Involve- 
ment as  individual  differences  (person)  variables.  The  difference  between 
the  analyses  was  in  the  definition  of  the  situational  variables.  For  the 

individual  analysis,  students'  individual  perceptions  of  the  instructor 
A 

were  used.  For  the  cl imate  analys ? s , each  student  was  assigned  his  or  her 
section  average  rating  for  the  four  CLIC  (situation)  variables. 


9 


In  each  analysis,  modified  hierarchial  multiple  regression  was  used 
with  ability  entered  first,  then  the  climate  variables  were  entered,  re- 
taining only  those  with  significant  beta  weights.  Then,  Student  Involvement 
was  entered  and  any  non-significant  climate  variables  were  dropped.  Student 
Involvement  was  entered  after  climate  on  the  assumption  that  part  of  the 
variance  in  Student  Involvement  is  a function  of  class  climate,  so  that  add- 
ing Student  Involvement  before  climate  would  underestimate  the  effect  of 
c 1 i ma  te . 

Person/situation  interactions  were  examined  via  the  added  contribution 
of  the  eight  products  of  the  two  person  variables  each  times  the  four  situa- 
tion variables.  For  the  individual  analysis,  individual  perceptions  were 
used,  while  for  the  climate  analysis  shared  perceptions  were  used. 

Missing  data  was  handled  by  pair-wise  deletion  during  computation  of 
correlations.  Multiple  regression  significance  tests  were  based  on  the 
lowest  in  the  correlation  matrix  (n=79i») . 

RESULTS 

Means,  stands  deviations,  reliability  estimates  and  IT  s for  each  vari- 
able are  presented  in  Table  1.  For  the  individual  variables,  internal  con- 
sistency reliabilities  are  based  on  Spearman- Brown  estimates  based  on  the 
average  intercorrelation  of  items  on  each  scale.  The  performance  reliabil- 
ity estimate  is  based  on  the  Spearman- Brown  corrected  average  intercorrela- 
tion of  the  five  examinations.  For  the  climate  variables,  interrater  re- 
liabilities were  estimated  by  an  odd-even  split  of  students  within  each  class 
computing  the  correlation  between  halves  across  all  class  sections  and 
correcting  the  correlations  by  the  Spearman- Brown  formula.  These  various 
estimates  of  reliability  indicate  that  with  the  exception  of  the  climate 
variable  called  Coordination  all  reach  clearly  acceptable  levels. 


Means  Standard  Deviations,  and  Reliability  Estimates 
for  Individual  and  Climate  Variables 


Variables 

X 

a 

N 

a 

rtt 

Individual 

Knowledge  and  Skill 

3.89 

.67 

915 

.86 

Consideration 

3.56 

.80 

915 

.82 

Critical  Demands 

1.92 

.60 

914 

.72 

Coordination 

3.18 

.70 

912 

.74 

Student  Involvement 

3.50 

.63 

908 

.74 

SAT  Math 

3.16 

.81 

794 

- 

Average  Test  Performance 

75.33 

13-74 

915 

.87 

Climate 

Knowledge  and  Skill 

3.89 

.32 

915 

.77 

Conside ration 

3.56 

.49 

915 

.90 

Critical  Demands 

1 .94 

.29 

915 

.84 

Coordination 

3.16 

.20 

915 

.19 

a 


See  text  for  description  of  reliability  estimates. 


1 1 

, I ntercorre la t ions  between  variables  are  presented  in  Table  2.  The 
best  single  predictor  of  performance  Is  the  individual  variable  Student 
Involvement  (r  - .38),  followed  by  SAT  hath  (£  - .33).  Shared  climate  corre- 
lations with  individual  performance  were  In  the  range  of  .07  to  .15  (abso- 
lute values),  while  individual  perceptions  of  climate  ranged  from  .11*  to 
.21  (again,  absolute  values). 

Individual  Analysis 

Variables  included  in  this  analysis  were:  student  performance  as  the 
criterion;  student  ability  and  individual  climate  perceptions  as  hypotheti- 
cal determinants  of  performance;  and  Student  Involvement  as  both  a deter- 
minant of  performance  and  a mediator  of  climate. 

Table  3 presents  the  regression  results.  As  indicated  above,  ability 
correlated  .33  with  performance,  representing  10.9%  of  the  variance  In 
performance.  With  ability  accounted  for,  all  four  individual  climate  per- 
ceptions were  significantly  (p  < . 0 1 ) related  to  performance.  For  Knowledge 
and  Skill,  Consideration,  Critical  Demands,  and  Coordination,  respectively, 
partial  correlations  were  .17.  .20,  -.13  and  .17.  Using  the  regression 
procedure,  three  of  those  four  scales  entered  and  remained  in  the  regression 
equation  with  significant  beta  weights.  These  were  Consideration,  Critical 
Demands  and  Coordination.  Together,  these  three  scales  added  6%  to  the 
variance  accounted  for  in  performance. 

Student  Involvement  was  then  entered  into  the  equation  and  it  had  a 
significant  weight  (g>  <.01)  but  the  contribution  of  Consideration  became 
non-significant  and,  therefore,  was  dropped  from  the  equation.  Ability, 
the  two  remaining  climate  perceptions  (Critical  Demands  and  Coordination) 
and  Student  Involvement  accounted  for  25%  of  the  variance  in  student  per- 


formance. 


Correlations  Among  Individual,  Climate  and  Performance  Variables 


NOTE:  Correlations  greater  than  .07,  £<.05;  correlations  greater  than  .09,  £<.01;  correlations  greater 
than  . 12,  £ <.001 . 
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Student  Involvement  was  then  entered  nto  the  equation  and  it  had  a 
significant  weight  (£  <.0I)  but  the  contribution  of  Consideration  became 
non-signi f leant  and,  therefore,  was  dropped  from  the  equation.  Ability, 
the  two  remaining  climate  perceptions  (Critical  Demands  and  Coordination) 
and  Student  Involvement  accounted  for  25%  of  the  variance  in  student  per- 
formance. 

As  a result  of  Consideration  being  dropped  from  the  regression  equa- 
tion, there  are  two  possible  ways  to  look  at  the  variance  accounted  for 
by  the  addition  of  Student  Involvement.  One  way  would  be  to  determine 
the  variance  that  Student  Involvement  adds  to  the  final  equation,  i.e., 
the  amount  that  Student  Involvement  adds  to  ability  and  the  two  climate 
perceptions.  However,  because  in  some  sense  Student  involvement  replaced 
Consideration,  perhaps  a more  meaningful  estimate  of  the  unique  variance 
contributed  by  Student  Involvement  is  to  compare  the  equation  containing 
Consideration  to  the  other  two  climate  perceptions  and  ability.  In  that 
way,  the  performance  variance  shared  by  Consideration  and  Student  Involve- 
ment Is  attributed  to  Consideration  not  Student  Involvement.  Thus,  a com- 
parison of  the  ability,  climate  and  Student  Involvement  model  to  the  ability 
plus  climate  model  indicates  that  Student  Involvement  uniquely  accounts 
for  8.2%  of  the  variance  in  performance,  at  least  for  this  system  of 
variables. * 

Alternatively,  one  could  argue  that  instructor  activities  and,  con- 
comitantly, student  perceptions  of  those  activities  are  in  part  a reaction 

^Other  assessments  of  the  class  climate  could  reduce  the  apparent  impact 
of  Student  Involvement.  That  is,  Student  Involvement  may  mediate  other 
unmeasured  aspects  of  classroom  climate. 


to  Student  Involvement  (cf.  Greene,  1975).  That  Is,  some  amount  of  the 
variance  in  the  climate  perception  may  be  determined  by  Student  Involve- 
ment, and  vice  versa.  If  this  is  the  case,  the  performance  variance  which 
may  be  attributed  to  Student  Involvement  would  be  greater  than  the  8.2$ 
derived  above.  Under  such  a condition  of  reciprocal  relationships,  it  is 
not  possible  to  state  precisely  how  much  of  the  performance  variance  ac- 
counted for  should  be  attributed  to  Student  Involvement.  However,  one 
can  bracket  that  amount  with  upper  and  lower  bound  estimates.  The  8.2$ 
defines  the  lower  bound  estimate  for  this  system  of  variables  (see  foot- 
note 1).  An  upper  bound  estimate  can  be  derived  by  determining  the  con- 
tribution that  Student  Involvement  adds  to  ability  alone.  The  last  line 
of  Table  3 shows  that  Student  Involvement  and  ability  combine  to  account 
for  23. 4$  of  the  variance  in  performance.  Thus,  Student  Involvement  adds 
12.5$  to  ability,  so  12.5$  can  be  taken  as  the  upper  bound  of  the  Student 
Involvement  contribution. 

Similarly,  upper  and  lower  bounds  can  be  derived  for  the  contribution 
of  the  climate  perceptions.  The  upper  bound  is  the  6$  which  the  three 
climate  variables  add  to  ability.  The  lower  bound  is  derived  from  com- 
paring the  abi 1 i ty/cl imate/Student  Involvement  model  to  the  abi I i ty/Student 
Involvement  model.  Thus,  the  1.7$  which  climate  adds  to  ability  and  Student 
Involvement  is  the  lower  bound  estimate  of  the  impact  of  climate  on  per- 
formance. 

Finally,  for  the  analysis  using  individual  perceptions  of  class  cli- 
mate, no  person/situation  interactions  were  significant. 

Another  way  to  phrase  these  results  is  that  the  unique  variance 
associated  with  climate  is  1.7$,  and  the  common  variance  in  performance 
shared  by  Student  Involvement  and  climate  is  4.3$.  Finally,  for  simplicity. 


ability  is  assumed  to  have  only  a direct  r<  ationship  (e.g.,  it  does  not 
mediate  Student  Involvement  or  climate)  and  it  accounts  for  10.9%  of  the 
variance  In  performance.  Thus,  the  total  variance  accounted  for  in  stu- 
dent  performance  using  only  individual  level  variables  is  25.1%. 

Ci imate  Analysis 

The  climate  analysis  parallels  the  individual  analysis  except  shared 
class  perceptions  (average  wi thin-class  individual  perceptions)  were  used 
as  climate  indices.  Table  4 presents  the  climate  regression  analyses  for 
student  performance. 

With  ability  held  constant,  all  four  climate  measures  were  signifi- 
cantly related  to  student  performance.  The  partial  correclations  were 
.15,  .1A,  .13  (all  £ <.01)  and  -.07  (£<.05)  for  Knowledge  and  Skill, 
Consideration,  Coordination  and  Critical  Demands,  respectively.  Only  two 
of  the  climate  measures  entered  and  remained  in  the  regression  solution 
after  ability  was  entered;  Knowledge  and  Skill,  and  Coordination.  Com- 
bined, they  increased  the  variance  accounted  for  in  performance  by  2.9% 

(R-  .37). 

Student  Involvement  was  entered  into  the  regression  equation,  adding 
10.9%  to  the  variance  accounted  for  (p_  < . 0 1 ) . Both  Knowledge  and  Skill, 
and  Coordination  remained  in  the  regression  equation  with  significant  re- 
gression weights  (£<.0I). 

Analogous  to  the  individual  analysis,  upper  and  lower  bounds  of  the 
linear  contribution  of  Student  Involvement  and  Climate  were  determined. 

The  lower  bound  of  Student  Involvement  is  the  10^|%  indicated  above.  The 
upper  bound  of  Student  Involvement  was  derived  in  the  individual  analysis 
as  12.5%  (i.e.,  increase  of  Student  Involvement  over  ability).  The  lower 
bound  of  climate  Is  the  dl fference be tween  the  abl 1 1 ty/Student  Involvement/ 
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climate  model  end  the  ebll I ty/Student  Involvement  model.  That  differ- 
ence is  1.3$.  The  upper  bound  is  the  2.9$  described  above.  In  other  words, 
the  unique  linear  contribution  of  Student  Involvement  is  10.9$,  the 
unique  linear  contribution  of  climate  is  1.3$  and  the  shared  contribution 
is  1.6$. 

In  addition  to  these  main  effects,  a significant  (j>  <.0I)  interaction 
was  found  between  Coordination  and  Student  ability.  Inclusion  of  the 
Coordination  times  ability  product  term  increases  the  performance  variance 
accounted  for  by  1.8$,  increasing  the  multiple  correlation  to  .51  (see 
the  last  row  in  Table  4). 

Since  an  interaction  indicates  that  the  effect  of  the  first  variable 
is  a function  of  the  second  and  vice  versa,  the  contribution  of  the  inter- 
action may  best  be  interpreted  as  shared  variance  accounted  for  in  per- 
formance. Thus,  the  above  accounting  system  is  revised  such  that  the 
total  shared  variance  is  3’**%.  That  shared  variance  now  represents  both 
mediated  relationships  (climate  through  Student  Involvement  and/or  Student 
Involvement  through  climate)  and  interaction  (climate  enhancing  the 
ability  relationship  and/or  ability  enhancing  the  climate  relationship). 

The  unique  linear  contributions  remain  the  same. 

The  standardized  regression  equation  yields  a regression  weight  for 

each  of  the  four  simple  terms  (two  individual  variables  and  two  climate 

variables)  plus  a weight  for  the  product  term.  By  algebraic  manipulation 

the  product  term  was  combined  with  the  student  ability  term  and  student 

ability  factored  out.  The  result  is  a weight  for  student  ability  which 

2 

Is  a function  of  shared  climate  perceptions  of  Coordination.  As  both 


2 

Ability  was  taken  as  a function  of  climate  because  the  climate  differ- 
ences represent  the  natural  grouping  (i.e.,  classes)  for  this  sample. 


the  weight  for  ability  and  Figure  1 indicate,  student  ability  has  a 
stronger  relationship  to  student  performance  when  class  Coordination  is 
high. 

As  argued  In  the  introduction,  the  existence  of  a significant  inter- 
action does  not  necessarily  imply  differences  in  predictability.  To 
examine  this  possibility,  students  were  grouped  according  to  the  Coordin- 
ation score  of  their  class.  Thus,  low  Coordination  students  were  those 
in  the  lowest  one-third  of  the  classes  (270  students.  Coordination  less 
than  3.005).  High  Coordination  students  were  in  the  top  one-third  of 
the  classes  (293  students, Coordination  greater  than  3.27).  Medium  Coor- 
dination students  were  in  the  24  classes  between  3*005  and  3-27  on  the 
Coordination  scale.  Means  and  standard  deviations  for  these  classes  on 
the  relevant  variables  appear  in  Table  5.  Mote  that  in  addition  to  the 
expected  differences  in  Coordi nation,  cl i mate  scores  across  the  three 
groups.  Knowledge  and  Skill  levels  and  performance  levels  also  vary  appro- 
priately from  the  low  to  high  group.  The  remaining  variables  tend  to  be 
stable  across  groups. 

Table  6 presents  the  data  relevant  to  the  issue  of  predictive  ac- 
curacy. 

First,  as  anticipated  from  the  significant  main  effects  of  Coordina- 
tion on  performance,  and  as  noted  above,  mean  performance  increases  from 
low  to  medium  to  high  Coordination  students.  These  mean  differences  ap- 
parently reflect  not  only  the  main  effects  of  Coordination  but  also  the 
facilitating  effect  Coordination  may  have  on  ability  and  the  potential 
effect  of  increased  Knowledge  and  Skill  In  the  high  Coordination  classes. 

In  other  words,  these  means  reflect  the  most  complete  general  statement 
about  the  gross  relationship  between  Coordination  (confounded  and  otherwise) 


coordi nation 


. Student  Ability/Class  Coordination  Interaction  on 
Student  Performance  (Plotted  in  z-scores). 
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Table  5 

Means  and  Standard  Deviations  of  Variables 
in  Coordination  Subgroup  Analysis 

Coordination  Subgroup 


Low 

Med i um 

High 

(N 

- 270) 

(N  » 

231) 

(N  - 

293) 

X 

0 

X 

0 

X 

0 

Ability 

3.13 

.86 

3.18 

.80 

3.18 

.75 

Student  Involvement 

3.44 

.61 

3.44 

.60 

3.60 

.64 

Knowledge  and  Skill 

3.80 

.26 

3.77 

.32 

4.07 

.26 

Coordination 

2.94 

.09 

3.16 

.05 

3.37 

.10 

Performance 

73.10 

13.89 

75.17 

13.02 

78.23 

12.93 
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Table  6 

Performance  Variance,  Error  Variance  and  Correlations 


for  Three  Levels 

of  Coordination 

Full  Composite 

Ability 

Prediction 

Prediction 

Coordination 

Performance 

Error  a b 

Error 

Group 

N 

Vari ance 

Variance  r 

Variance 

r_ 

Low 

270 

193-05 

162.27  .1*0 

133.18 

.31 

Med! urn 

231 

169.82 

I32.A6  .1*7 

113.76 

.33 

High 

293 

167-39 

124.26  .51 

107.13 

• 36 

3 Low  and  high 

groups  significantly 

d i fferent  at  £ < . 

.05. 

k Indicates  correlat 

ion  between  predicted  performance 

and  actual 

performance 

where  prediction 

is  based  on  the 

regression  equation  derived 

from  the 

full  sample. 

Low  and  high  groups  significantly  different  at  £ <.05. 


i 


L 


1 
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and  level  of  student  performance. 

Table  6 also  shows  performance  variance  and  error  variance  for  stu- 
dents within  each  of  the  three  classifications.  Error  variance  was 
calculated  by  first  using  the  raw  score  regression  equation  derived 
for  the  total  sample  to  calculate  a predicted  score  (Y1)  for  each  student. 
The  following  formula  was  then  used  within  each  group  to  calculate  error 

variance:  £ (Y  - Y1  )^. 

N 

Performance  variance  and  error  variance  both  show  a decreasing  pattern 
from  low  to  medium  to  high  Coordination  classes.  For  the  high  and  low 
Coordination  groups  the  difference  in  error  variance  is  significant 

1.31.  £. <-os>. 

The  difference  in  performance  variance  (though  non-significant)  sug- 
gests a higher  correlation  between  predicted  performance  and  actual  per- 
formance in  low  Coordination  classes,  while  the  difference  in  error  vari- 
ance suggests  a higher  correlation  for  high  Coordination  classes.  In 
fact,  the  correlation  between  predicted  performance  and  actual  performance 
increases  from  low  to  high  Coordination  classes,  but  the  difference  be- 
tween them  only  approaches  the  traditional  level  of  significance  (z  = 1.64, 
£<.10).  Thus,  within-group  accuracy  of  prediction  (i.e.,  within  group  r) 
Is  at  best  marginally  better  for  high  Coordination  groups,  while  prediction 
accuracy  compared  to  actual  performance  (error  variance)  Is  significantly 
better  for  high  Coordination  groups.  This  pattern  occurs  in  spite  of  a 
contradictory  trend  for  performance  variance  to  decrease  In  high  Coordin- 
ation groups. 

Similar  conclusions  are  reached  when  ability  is  examined  by  itself. 
That  is,  the  difference  between  the  ability/performance  correlations  are 


not  significant  at  the  .06  level,  however  (he  error  variances  are  differ- 
ent (£  < .05) . 

DISCUSSION 

Comparing  analyses  of  t > ,i  perceptions  and  shared  perceptions 

of  climate,  and  comparing  Indivi.  • differences  variables  and  climate 
variables  within  these  analv..  ember  of  significant  points  can  be 

discussed.  However,  perhaps  t -o*-:  significant  aspect  of  the  results 
Is  that,  whichever  analysis  Is  examined,  a relatively  large  proportion 
of  the  variance  in  student  class  per rormance  is  accounted  for  with  re- 
latively few  indices  taken  from  .1  > miplex  setting. 

Personnel  selection  writers  have,  long  been  lamenting  Gh I se Ill's 
(1956)  finding  that  the  average  published  ab i I i ty/performance  correla- 
tion is  in  the.  neighborhood  ot  . Similarly,  motivation  theorists 
(e.g.,  Miner  & Dachler,  197V.  H»-.«  . . 19/6)  have  commented  that  motivation 

variables  do  not  typically  exceed  . correlation  of  .35.  Cronbach  and  Snow 
(Note  l)  comment  on  the  failure  ot  educational  researchers  to  calculate 
etas  for  their  experimental  treatments,  but  one  suspects  that  these,  too, 
would  not  ^ expected  to  often  toll  above  .36. 

If  the  results  for  this  study  irt  examined  as  zero  order  effects 
only,  the  pattern  of  .35  results  Is  repeated.  That  Is,  ability  alone 
correlated  . 33  wi th  performance  t lent  Involvement,  which  can  be  In- 
terpreted as  a behavioral  description  of  course  motivation,  correlated 
.38  with  performance.  The  climate  indices  failed  to  reach  rhe  .35  ex- 
pectation with  the  highest  individual  perception  correlation  reaching 
.21  and  the  highest  shared  perception  reaching  only  . 1 . 

With  the  "failure"  of  am  one  class  of  variables  to  account  for 
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more  than  15%  of  performance  variance,  the  next  theoretical  step  was 
to  argue  for  examination  of  both  individual  and  situational  variables 
at  the  same  time  In  Interaction  (Cronbach,  1957).  That  approach  had  led 
to  some  success  (e.g.  House  & Mitchell,  1971*;  Kerr  et  al.,  197**)  and 
some  disappointments  (Cronbach,  1975).  However,  in  the  rush  to  find 
interactions,  there  seems  to  have  been  a tendency  to  overlook  the  import- 
ance of  the  simple  additive  effects  of  variables  of  different  kinds 
(Schneider,  1978b).  Thus,  in  the  two  analyses  of  this  study,  only  one 
interaction  out  of  sixteen  possibilities  was  found  to  be  statistically 
significant.  While  that  one  interaction  allows  a number  of  interesting 
supplementary  analyses  that  are  not  meaningful  In  the  absence  of  Inter- 
action effects,  one  should  not  overlook  the  fact  that  a considerably 
larger  proportion  of  the  performance  variance  is  accounted  for  by  the 
simple  additive  combination  of  variables  (R  - .50  for  the  individual 
analysis  and  .50  for  the  climate  analysis  without  the  interaction)  than 
by  any  one  kind  of  variable  by  itself  (ability,  motivation,  climate). 

That  is,  25%  of  the  variance  in  performance  is  accounted  for  by  six 
possible  variables  (two  individual  and  four  climate)  which  are  inter- 
twined such  that  only  four  of  them  are  included  in  the  regression  func- 
tion. 

Comparison  between  individual  differences  and  climate  variables 
would  seem  to  support  the  contention  that  individual  differences  are 
the  strongest  correlate  of  performance.  On  the  other  hand,  (a)  the 
teacher  activities  assessed  as  climate  (either  via  individual  perceptions 
or  shared  perceptions)  did  relate  to  student  performance,  and  (b)  there 
remains  a large  part  of  performance  which  is  unexplained,  some  of  which 
may  be  attributable  to  other  unmeasured  teacher  activities. 
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Comparison  between  the  individual  perceptions  of  climate  and  the 
shared  perceptions  of  climate  reveal  two  d ferences.  First,  the  climate 
variables  that  entered  the  regression  functions  varied  depending  upon 
their  use  as  Individual  or  climate  data.  That  is,  while  Coordination 
entered  the  equation  in  each  case.  Critical  Demands  entered  the  individual 
analysis  equation  and  Knowledge  and  Skill  entered  the  climate  analysis 
equation.  Because  all  four  climate  variables,  taken  as  either  the  in- 
dividual perception  or  the  shared  perceptions,  were  significantly 
related  to  performance  (both  before  and  after  ability  was  controlled), 
the  result  that  Knowledge  and  Skill  entered  one  analysis  while  Critical 
Demands  entered  the  other  may  be  more  a function  of  the  intercorrelation 
of  the  variables  rather  than  their  separate  relationships  to  performance. 

Since  (a)  at  any  step  in  the  regression  procedure,  the  variable  chosen 
for  entry  is  the  one  with  the  largest  part  correlation,  and  (b)  the 
differences  between  these  part  correlations  is  not  tested,  the  selection 
of  one  variable  over  another  may  be  partly  a function  of  chance.  Perhaps 

I 

the  most  appropriate  conclusion  is  simply  that  Knowledge  and  Skill  and 
Critical  Demands,  and  for  that  matter  Consideration,  share  overlapping 
associations  with  student  performance. 

The  second  difference  between  the  individual  analysis  and  the  c 1 1 — 

i 

mate  analysis  is  the  appearance  of  the  Coordination  X ability  interaction 
In  the  climate  analysis.  A possible  explanation  lies  in  the  low  inter- 
rater reliability  of  the  shared  perception  of  Coordination  coupled  with 
the  significant  correlation  between  ability  and  individual  perceptions  of 


Coordination.  Thus,  one  could  argue  that  differences  in  individual  abil- 
ity lead  to  differences  in  the  way  students  perceive  class  Coordination, 
and  these  differences  In  perception  lead  to  low  agreement  between  students 


within  each  class.  If  one  could  assume  that  there  is  some  "true"  level 
of  class  Coordination  which,  although  students  do  not  agree,  is  approxi- 
mated by  the  average  of  their  perceptions,  then  one  could  also  argue 
that  the  ability  X Coordination  interaction  indicates  that  greater  coor- 
dination of  readings,  lectures  and  examinations,  does  facilitate  the  learn- 
ing of  higher  ability  students  more  than  that  of  lower  ability  students. 

If  the  interaction  term  is  conceptualized  as  an  adjustment  for  the  main 
effect  of  Coordination,  the  adjustment  is  not  needed  using  the  individual 
perceptions  because  the  perceptions  themselves  carry  the  adjustment. 

That  is,  the  interaction  is  confounded  in  the  individual  perceptions  of 
Coordination.  By  aggregating  individual  perceptions  into  an  average  per- 
ception, that  ability  contamination  is  reduced  (at  the  expense  of  reli- 
ability) al  lowing  the  interaction  to  appear. 

Further  examination  of  the  Coordination  X ability  interaction,  l.e., 
by  examining  Coordination  subgroups,  revealed  that  high  Coordination  does 
not  function  to  overcome  the  deficiencies  of  low  ability  students,  but 
rather  allows  high  ability  students  to  express  their  abilities  as  Schneider 
(1978a)  hypothes i zed.  Thus,  students  in  higher  Coordination  class  have 
a higher  group  mean  and  their  performance  is  more  predictable  (as  defined 
by  the  error  variance)  using  ability  by  itself  or  using  the  complete 
abil ( ty /Student  Involvement/climate  prediction  equation. 
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Footnotes 

*0ther  assessments  of  the  class  climate  could  reduce  the  apparent 
impact  of  Student  Involvement.  That  is.  Student  Involvement  may  mediate 
other  unmeasured  aspects  of  classroom  climate. 

I 2 

« Ability  was  taken  as  a function  of  climate  because  the  climate 

differences  represent  the  natural  grouping  (i.e.,  classes)  for  this 
sample. 
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